From efficacy to effectiveness: a comprehensive framework for monitoring, evaluating and optimizing seasonal malaria chemoprevention programmes.

BACKGROUND: Seasonal Malaria Chemoprevention (SMC) is a highly effective intervention for preventing malaria, particularly in areas with highly seasonal transmission. Monitoring and evaluating (M&E) SMC programmes are complex due to the scale, time-sensitive delivery of the programme, and influence of external factors. This paper describes the process followed to develop a comprehensive M&E framework tailored specifically for the SMC context. METHODS: The Framework was developed through a literature and programme review, and stakeholder dialogues across three implementing countries-Burkina Faso, Chad, and Nigeria. Expert consultation further refined the Framework through an iterative approach drawing upon data collected through the three sources. The Framework was designed using the Logical Framework Approach incorporating external factors and intentionally aligned with global malaria M&E standards. RESULTS: An overall aim and seven programme objectives were developed measured by 70 indicators. The indicators also capture the causal links between the implementation and results of the programme. The Framework leverages the use of current data sources and existing mechanisms, ensuring efficient data use without requiring a significant increase in resources for overall programme optimization. It also promotes the use of data triangulation, and stratification for a more nuanced understanding of factors affecting programme performance and timely data informed decision-making. CONCLUSIONS: The SMC M&E Framework presented here provides a standardized approach for programme implementers to enhance decision-making for optimal programme performance. This is an essential tool as the scope of SMC programmes expands to new geographies and target age groups.

Impact of seasonal malaria chemoprevention on prevalence of malaria infection in malaria indicator surveys in Burkina Faso and Nigeria.

BACKGROUND: In 2012, the WHO issued a policy recommendation for the use of seasonal malaria chemoprevention (SMC) to children 3-59 months in areas of highly seasonal malaria transmission. Clinical trials have found SMC to prevent around 75% of clinical malaria. Impact under routine programmatic conditions has been assessed during research studies but there is a need to identify sustainable methods to monitor impact using routinely collected data. METHODS: Data from Demographic Health Surveys were merged with rainfall, geographical and programme data in Burkina Faso (2010, 2014, 2017) and Nigeria (2010, 2015, 2018) to assess impact of SMC. We conducted mixed-effects logistic regression to predict presence of malaria infection in children aged 6-59 months (rapid diagnostic test (RDT) and microscopy, separately). RESULTS: We found strong evidence that SMC administration decreases odds of malaria measured by RDT during SMC programmes, after controlling for seasonal factors, age, sex, net use and other variables (Burkina Faso OR 0.28, 95% CI 0.21 to 0.37, p<0.001; Nigeria OR 0.40, 95% CI 0.30 to 0.55, p<0.001). The odds of malaria were lower up to 2 months post-SMC in Burkina Faso (1-month post-SMC: OR 0.29, 95% CI 0.12 to 0.72, p=0.01; 2 months post-SMC: OR: 0.33, 95% CI 0.17 to 0.64, p<0.001). The odds of malaria were lower up to 1 month post-SMC in Nigeria but was not statistically significant (1-month post-SMC 0.49, 95% CI 0.23 to 1.05, p=0.07). A similar but weaker effect was seen for microscopy (Burkina Faso OR 0.38, 95% CI 0.29 to 0.52, p<0.001; Nigeria OR 0.53, 95% CI 0.38 to 0.76, p<0.001). CONCLUSIONS: Impact of SMC can be detected in reduced prevalence of malaria from data collected through household surveys if conducted during SMC administration or within 2 months afterwards. Such evidence could contribute to broader evaluation of impact of SMC programmes.

Health management information system (HMIS) data quality and associated factors in Massaguet district, Chad.

BACKGROUND: Quality data from Health Management Information Systems (HMIS) are important for tracking the effectiveness of malaria control interventions. However, HMIS data in many resource-limited settings do not currently meet standards set by the World Health Organization (WHO). We aimed to assess HMIS data quality and associated factors in Chad. METHODS: A cross-sectional study was conducted in 14 health facilities in Massaguet district. Data on children under 15 years were obtained from the HMIS and from the external patient register covering the period January-December 2018. An additional questionnaire was administered to 16 health centre managers to collect data on contextual variables. Patient registry data were aggregated and compared with the HMIS database at district and health centre level. Completeness and accuracy indicators were calculated as per WHO guidelines. Multivariate logistic regressions were performed on the Verification Factor for attendance, suspected and confirmed malaria cases for three age groups (1 to < 12 months, 1 to < 5 years and 5 to < 15 years) to identify associations between health centre characteristics and data accuracy. RESULTS: Health centres achieved a high level of data completeness in HMIS. Malaria data were over-reported in HMIS for children aged under 15 years. There was an association between workload and higher odds of inaccuracy in reporting of attendance among children aged 1 to < 5 years (Odds ratio [OR]: 10.57, 95% CI 2.32-48.19) and 5- < 15 years (OR: 6.64, 95% CI 1.38-32.04). Similar association was found between workload and stock-outs in register books, and inaccuracy in reporting of malaria confirmed cases. Meanwhile, we found that presence of a health technician, and of dedicated staff for data management, were associated with lower inaccuracy in reporting of clinic attendance in children aged under five years. CONCLUSION: Data completeness was high while the accuracy was low. Factors associated with data inaccuracy included high workload and the unavailability of required data collection tools. The results suggest that improvement in working conditions for clinic personnel may improve HMIS data quality. Upgrading from paper-based forms to a web-based HMIS may provide a solution for improving data accuracy and its utility for future evaluations of health interventions. Results from this study can inform the Ministry of Health and it partners on the precautions to be taken in the use of HMIS data and inform initiatives for improving its quality.

Modeled Impact of Seasonal Malaria Chemoprevention on District-Level Suspected and Confirmed Malaria Cases in Chad Based on Routine Clinical Data (2013-2018).

Sulfadoxine-pyrimethamine plus amodiaquine is delivered to children aged 3-59 months as seasonal malaria chemoprevention (SMC) in areas where transmission is highly seasonal such as Chad and other Sahelian countries. Although clinical trials show a 75% reduction in malaria cases, evidence of SMC's impact at scale remains limited. Using data from the Chadian National Health Management Information System, we analyzed associations between SMC implementation during July-October and monthly district-level malaria incidence (suspected and confirmed outpatient cases) among children aged 0-59 months at health facilities in 23 health districts with SMC implementation during 2013-2018. Generalized additive models were fitted with separate cyclic cubic spline terms for each district to adjust for seasonality in cases. SMC implementation in Chad was associated, compared with no implementation, with lower monthly counts of both suspected (rate ratio [RR]: 0.82, 95% CI: 0.72-0.94. P = 0.006) and confirmed malaria cases (RR: 0.81, 95% CI: 0.71-0.93, P = 0.003), representing around 20% reduction in malaria incidence. Sensitivity analyses showed effect sizes of up to 28% after modifying model assumptions. Caution should be exercised in interpreting our findings, which may not be comparable with other studies, and may over- or underestimate impact of SMC; not all malaria cases present at health facilities, not all suspected cases are tested, and not all facilities report cases consistently. This study's approach presents a solution for employing readily available routine data to evaluate the impact of health interventions at scale without extensive covariate data. Further efforts are needed to improve the quality of routine data in Chad and elsewhere.

Usability and acceptability of a multimodal respiratory rate and pulse oximeter device in case management of children with symptoms of pneumonia: A cross-sectional study in Ethiopia.

AIM: Pneumonia is the leading infectious cause of death among children under five globally. Many pneumonia deaths result from inappropriate treatment due to misdiagnosis of signs and symptoms. This study aims to identify whether health extension workers (HEWs) in Ethiopia, using an automated multimodal device (Masimo Rad-G), adhere to required guidelines while assessing and classifying under five children with cough or difficulty breathing and to understand device acceptability. METHODS: A cross-sectional study was conducted in three districts of Southern Nations, Nationalities, and Peoples' Region, Ethiopia. Between September and December 2018, 133 HEWs were directly observed using Rad-G while conducting 599 sick child consultations. Usability was measured as adherence to the World Health Organization requirements to assess fast breathing and device manufacturer instructions for use. Acceptability was assessed using semi-structured interviews with HEWs, first-level health facility workers and caregivers. RESULTS: Adherence using the Rad-G routinely for 2 months was 85.3% (95% CI 80.2, 89.3). Health workers and caregivers stated a preference for Rad-G. Users highlighted a number of device design issues. CONCLUSION: While demonstrating high levels of acceptability and usability, the device modifications to consider include better probe fit, improved user interface with exclusive age categories and simplified classification outcomes.

Usability and acceptability of an automated respiratory rate counter to assess childhood pneumonia in Nepal.

AIM: Pneumonia is the leading cause of child death after the neonatal period, resulting from late care seeking and inappropriate treatment. Diagnosis involves counting respiratory rate (RR); however, RR counting remains challenging for health workers and miscounting, and misclassification of RR is common. We evaluated the usability of a new automated RR counter, the Philips Children's Respiratory Monitor (ChARM), to Female Community Health Volunteers (FCHVs), and its acceptability to FCHVs and caregivers in Nepal. METHODS: A cross-sectional study was conducted in Jumla district, Nepal. About 133 FCHVs were observed between September and December 2018 when using ChARM during 517 sick child consultations, 264 after training and 253 after 2 months of routine use of ChARM. Acceptability of the ChARM was explored using semi-structured interviews. RESULTS: FCHV adherence to guidelines after 2 months of using ChARM routinely was 52.8% (95% CI 46.6-58.9). The qualitative findings suggest that ChARM is acceptable to FCHVs and caregivers; however, capacity constraints such as older age and low literacy and impacted device usability were mentioned. CONCLUSION: Further research on the performance, cost-effectiveness and implementation feasibility of this device is recommended, especially among low-literate CHWs.

Knowledge, attitudes and practices with regard to schistosomiasis prevention and control: Two cross-sectional household surveys before and after a Community Dialogue intervention in Nampula province, Mozambique.

BACKGROUND: The Community Dialogue Approach is a promising social and behaviour change intervention, which has shown potential for improving health seeking behaviour. To test if this approach can strengthen prevention and control of schistosomiasis at community level, Malaria Consortium implemented a Community Dialogue intervention in four districts of Nampula province, Mozambique, between August 2014 and September 2015. METHODOLOGY/PRINCIPAL FINDINGS: Cross-sectional household surveys were conducted before (N = 791) and after (N = 792) implementation of the intervention to assess its impact on knowledge, attitudes and practices at population level. At both baseline and endline, awareness of schistosomiasis was high at over 90%. After the intervention, respondents were almost twice as likely to correctly name a risk behaviour associated with schistosomiasis (baseline: 18.02%; endline: 30.11%; adjusted odds ratio: 1.91; 95% confidence interval: 1.14-2.58). Increases were also seen in the proportion of people who knew that schistosomiasis can be spread by infected persons and who could name at least one correct transmission route (baseline: 25.74%; endline: 32.20%; adjusted odds ratio: 1.36; 95% confidence interval: 1.01-1.84), those who knew that there is a drug that treats the disease (baseline: 29.20%, endline: 47.55%; adjusted odds ratio: 2.19; 95% confidence interval: 1.67-2.87) and those who stated that they actively protect themselves from the disease and cited an effective behaviour (baseline: 40.09%, endline: 59.30%; adjusted odds ratio: 2.14; 95% confidence interval: 1.40-3.28). The intervention did not appear to lead to a reduction in misconceptions. In particular, the belief that the disease is sexually transmitted continued to be widespread. CONCLUSIONS/SIGNIFICANCE: Given its overall positive impact on knowledge and behaviour at population level, Community Dialogue can play an important role in schistosomiasis prevention and control. The intervention could be further strengthened by better enabling communities to take suitable action and linking more closely with community governance structures and health system programmes.